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ABSTRACT 

We analyze the power spectrum of a QSO's Lya transmitted flux in the dis- 
crete wavelet transform (DWT) representation. Although the mean DWT power 
spectrum is consistent with its counterpart in Fourier representation, the spatial 
distribution of the local power varies greatly, i.e. the local DWT power spectra 
show remarkably spiky structures on small scales. To measure these spiky fea- 
tures, we introduce the quantities roughness of the local power spectrum, and 
the correlation between spikes on different scales. We then test the predictions 
made by the correlation hierarchy model on the roughness and the scale-scale 
correlations of the local power spectrum. Using the Lyct transmitted flux of the 
QSO HS1700, we find that the underlying cosmic mass field of the transmitted 
flux at redshift around z ~ 2.2 can be described by the hierarchical clustering 
model on physical scales from 2.5 h~^ Mpc to few tens h~^ kpc in an Einstein-de 
Sitter universe. However, the non-linear features of the clustering show differ- 
ences on different scale ranges; 1. On physical scales larger than ~ 1.3 h^^ Mpc, 
the field is almost Gaussian. 2. On scales 1.3 h~^ Mpc - 0.3 h~^ Mpc, the field is 
consistent with the correlation hierarchy with a constant value for the coefficient 
Q4. 3. On scales less than 300 h~^ kpc, the field is no longer Gaussian, but es- 
sentially intermittent. In this case, the field can still be fitted by the correlation 
hierarchy, but the coefficient, Q4, should be scale-dependent. These three points 
are strongly supported by the following result: the scale dependencies of Q4 given 
by two statistically independent measures, i.e. Qf by the roughness and Q'^ by 
scale-scale correlation, are the same in the entire scale range considered. 

Subject headings: cosmology: theory - large-scale structure of the universe 



1. Introduction 



The most popular statistical measure of the cosmic mass density field p(x) is the Fourier 
power spectrum. For a homogeneous and isotropic random mass field, the Fourier power 
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spectrum P{k) is given by 

{S^S^') = P{k)S^,^>: (1) 

where (...) is the average over an ensemble, is the Fourier transform of the density contrast 
5(x) = (p(x)— p) /p, pis the average density and 5^^' Kronecker-Delta function. Although 
the power spectrum is only a second order statistical measure of the inhomogeneity of the 
random density field, it directly reflects the scales on which non-linear physical processes 
affect structure formation. 

The Fourier power spectrum, however, loses spatial information completely because of 
the non-local nature of the Fourier mode. Thus, it cannot be used to describe position- 
related statistical features of the mass field. In other words, the power spectrum, or the 
galaxy-galaxy correlation function cannot detect large scale filaments and sheets in the galaxy 
distribution. This disadvantage is clearly seen when reconciling the power spectrum descrip- 
tion with the singular behavior of the cosmic mass field (Navarro, Frenk, & White 1997; 
Moore et al. 2000; Jing & Suto 2000). The existence of singular structures, like massive 
halos with density profiles p{r) oc r~°' {a > 0) indicates that the power of mass density 
perturbations on scale r oc 1/A; is not uniformly distributed in space, but concentrated in 
rare high power regions. This problem calls for a description of local power spectrum, which 
provides the information of power distribution with respect to both the scale and physical 
position of the fluctuation. 

The local power spectrum of the underlying mass field of a QSO's Lya forest has been 
recently analyzed (Jamkhedkar, Zhan, & Fang 2000). It is found that the local power 
spectrum of the transmitted fiux of the QSO's absorption shows prominent spiky structures 
on small scales. That is, the transmitted fiux consists of rare but strong density fiuctuations 
randomly scattered in space with very low power of fiuctuations in between. Moreover, 
the spiky features are more significant on smaller scales. This indicates an excess of large 
fluctuations on small scales in comparison to a Gaussian distribution, i.e. the random mass 
fleld traced by the Lyct transmitted flux probably is intermittent (Zeldovich, Ruzmaikin, & 
Sokoloff 1990; Frisch 1995; Shraiman & Siggia 2000). The local power spectrum is especially 
useful for describing the non-linear features of the cosmic mass fleld, and thus for testing 
models of the non-linear clustering of the cosmic mass fleld. 

The purpose of this paper is to test the most popular non-linear clustering model - 
the hierarchical clustering model. The hierarchical clustering scenario (e.g. White 1979) 
assumes that the non-linear cosmic mass fleld satisfles a linked-pair approximation, or cor- 
relation hierarchy, i.e. ^„ ~ QnC2~^j where ^„ and ^2 are the n- and 2-point correlation 
functions of mass density, respectively. The coefficients Q„s are assumed to be constant or 
scale- independent. This model has been widely applied to construct semi-analytic models of 



3 



gravitational clustering in the universe. With the correlation hierarchy, all high order corre- 
lation functions are given by two-point correlation functions and coefficients QnS. Therefore, 
in hierarchical clustering model, the spiky features of the local power spectrum should also 
be produced by the two point correlation function and QnS. Thus, the applicable range of 
the correlation hierarchy can be determined by comparing these predictions with observed 
local power spectrum. 

The paper is organized as follows. The first half (§2 and §3) studies the statistical 
features of the local power spectrum of the underlying mass field revealed by the QSO's Lya 
forest. The second half (§4 and §5) investigates the local power spectrum of the hierarchically 
clustered field. §2 provides a brief background of local power spectrum in the discrete wavelet 
transform (DWT) representation. The local power spectra measured from Lya transmitted 
flux of QSO HS1700-I-64 are presented in §3. The focus there is on the spiky features and 
roughness of the local power spectrum. In §4, we investigate the predication of roughness 
and scale-scale correlation of the spiky structures given by the linked-pair approximation. 
We then test these predictions with the observed local power spectrum, and obtain the 
applicable range of the correlation hierarchy for the cases of a constant and scale-dependent 
Q. §5 consists of the conclusions and discussions. 



For the sake of simplicity, we analyze a 1-D density distribution sample p{x) in the 
range < a; < L, which is assumed to be a stationary random field. It is straightforward to 
extend the results to 2-D and 3-D. 

The first generation of the algorithm of local power spectrum is the windowed Fourier 
analysis (Gabor 1946), which decomposes a distribution p{x) as 



where g{x — xq) is a window function of size Ax around position xq. Wc thus define a local 
power spectrum at xq as \p{k,Xo)\'^. However, for a given spatial size Ax, the uncertainty 
in the wavenumber is AA: ~ 2n/Ax. Consequently, the local power spectrum |p(/c,a;o)P 
is uncertain on scales k < 2n/Ax. This problem leads to the development of the discrete 
wavelet transform (DWT), which decomposes p{x) with orthogonal and complete bases on 
successive scales obeying the condition AkAx ~ 27r. Indeed, the transform in eq.(2) is a 
predecessor of the DWT. 



2. Local power spectrum 



2.1. Power spectrum in the DWT representation 




(2) 
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To apply the DWT, we first chop L into 2^ subintervals, each of which spans a spatial 
range labeled with / = 0, ...2^ — 1, and the subinterval / is from to L(l + l)/2^ . 

The density contrast, S{x) — {p{x) — p)/p, can be decomposed as^ 

oo 23-1 

'^(^) = (3) 

j=0 1=0 

where ipj,i{x) with j = 0, 1, ... and I — 0, ...2^ — 1 are the orthogonal and complete bases of the 
discrete wavelet transform (DWT) (Daubechies 1992; Fang & Thews 1998). The non-zero 

range of ipj,i{x) is mainly between lL/2^ and (/ + 1)L/2K The wavelet function coefficient 
(WFC), ij^i, in eq.(3) is obtained by projecting 5{x) onto ipj,i{x) 

ej,i = J S{x)ipj,i{x)dx. (4) 

The ij^i describes the density perturbation at the position IL/2-' on the length scale L/2^ (or, 
the wavelet scale j). For a Haar wavelet the WFC, ij^i, is the difference between the mean 
density contrasts in ranges lL/2^ < x < {I + l/2)L/2^ and {I + l/2)L/2^ <x< {1 + l)L/2K 
For other wavelets, the WFC, Ij^i, is also a measure of the density contrast difference on a 
scale L/2^ at a position /. We will use the Daubechies 4 wavelet (Daubechies 1992) in our 
numerical calculation below. 

The decomposition eq.(3) preserves all the information contained in the original field. 
Consider a sample with a resolution of L/2'' , which is equivalent to 2^ grid-points on L. 
The degree of freedom of the sample is then 2^^ — 1, where the condition of average 5 — Q 
reduces one degree of freedom. Since the local density fluctuations have to be measured over 
at least two neighboring grids, the smallest length, on which the WFCs can be calculated, is 
2 X (L/2"^). The corresponding scale, j, is then J — 1. Thus, the total number of the WFCs 
(j = 1...J- 1, and / = 0...2^) is 

j-i 

^2-^-^ = 2-^-1. (5) 

i=i 

Therefore, the WFCs contain complete information of the random field in the DWT repre- 
sentation. The original distribution, 5{x), can be exactly and unredundantly reconstructed 
from the WFCs. 



^To be exact, the distribution 6{x) in eqs.(3) and (4) is a periodic extension of the density field over an 
interval of length L (Fang & Feng 2000). 
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Parseval's theorem for the DWT decomposition is (Fang & Thews 1998) 

L oo 2^-1 

\5{x)\'dx^Y.L^'li^ (6) 

,7=0 /=0 

which imphes that the power of perturbations can be decomposed into modes (j, /). The 
power of the mode (j, /) is given by e|j. Thus the power spectrum in the DWT representation 
is given by (e^;), where (...) is for the ensemble average. If the random field is stationary (or 
homogeneous in higher dimensions), (e|;) has to be independent of One can then define 
the DWT power spectrum as 

= (7) 
If the "fair sample hypothesis" (Peebles 1980) holds, instead of the ensemble average of 
eq.(6), we can use the average over I, i.e. 

1=0 

It has been shown that Pj is actually a band-avcragcd Fourier power spectrum P{k) around 
k = 27:2^ /L (Pando & Fang 1998; Fang & Feng 2000), i.e. 

oo 

Pj-^H mn/2^)\'m, (9) 

n=— oo 

where P{k) is the Fourier power spectrum with the wavenumber k = 2nn/L, and ■4j{n/2^) 
is the Fourier transform of the basic wavelet i/j{x). The non-zero range of i/j{n/2^) is only 
around n/2^ ~ Ug, where Ug depends on wavelets. For the Daubechies 4 wavelet, Ug ~ ±1. 

The wavenumber difference between scales j and j + 1 is Ak = 2tt{2^^^—2^)/L = 27r/Aa;, 
with Ax = L/2K Therefore, the resolution of the DWT power spectrum is not as dense as 
the Fourier power spectrum. The Fourier modes are uniformly distributed over the scale 
space, while the Pj's are distributed on octaves. However, this does not mean that the DWT 
decomposition losses information (Fang & Feng 2000). Besides the DWT power spectrum 
Pj, the second order DWT statistics also provide information about the spatial distribution 
of the power. Thus, an advantage of the DWT representation is its ability to calculate the 
local power spectrum. 

2.2. The local DWT power spectrum 

The Fourier power spectrum P{k) lacks phase information, and, therefore, cannot reveal 
the position-related features of clustering. The DWT power spectrum Pj doesn't either, but 
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the DWT mode {j, I) contains information of positions as it is localized at I. Therefore, the 
power of density fluctuations at the position I and on the scale j is measured by 

P,,i = ^li- (10) 
That is, Pj^i vs. j is the power spectrum of density perturbations localized at the position I. 

We can also define the band-averaged local DWT power spectrum. First, we chop L 
into 2^' {js < j) sub-intervals labeled as Ig — 0, l...{2^' — 1). Each sub-interval has a length 
Thus, the local DWT power spectrum averaged in the sub-interval Ig is given by 

Pj,{jsM = ^jzj; ^ = ^jZj; ^ (H) 

l=l^2i-is l=l^2i-is 

Pj,{js,h} generally varies with Is, and it measures the spatial distribution of the power on 
scale j among the sub-intervals. Therefore, the spatial distribution Pj,{j^,i^} actually is the 
spatial distribution of Pj^i smoothed on the scale js- 

Obviously, when js = j (and so / = Is), the local power spectrum eq.(ll) reduces to 
eq.(lO), i.e. 

PWA = Pj,i (12) 

On the other hand, when jg = (and so Is = 0), i.e. the smoothing is done over the entire 
length L, Pj,{j^,i,} is the power averaged over the entire region L, i.e. 

^.,{0,0} = Pj = ^J2 'h- (13) 

Therefore, Pj.{js.is} provides a multiresolutional view of the phase space distribution of the 
power of the density perturbations. 



3. Local power spectra of Lya transmitted flux 

3.1. Samples and power spectra 

High resolution spectra of Lya forest QSOs are good candidates to study the local 
power spectrum of the cosmic mass field. The transmission F{x) of Lya forests is due to the 
absorption by gases in cool and low density regions. The pressure gradients are generally 
smaller than gravitational forces. The distribution of cool baryonic diffuse matter is almost 
point-by-point proportional to the underlying dark matter density (Bi, Ge & Fang 1995). 
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We use the normalized Lya transmitted flux of QSO HS1700+64 {z = 2.72) for our 
analysis. This sample has been employed to study the evolution of structures (Bi & Davidsen 
1997), and the Fourier and DWT power spectra (Feng & Fang 2000). The data ranges from 
3727. OI2A to 5523. 554A, with a total of 55882 pixels. In this paper, we use the data from 
A = 3815. GA to 4434. 3A, which correspond to 2; = 2.14 ~ 2.65. The lower limit of the 
wavelength is set to exclude Ly/3 absorption. On average, a pixel is about 0.028A, equivalent 
to a proper distance of ~ 5 h~^ kpc at z ~ 2 for an Einstein-de Sitter universe. Moreover, 
we subject DWT directly to pixels without transforming them to physical positions. The 
physical position is related to the pixel number in a non-linear way, but the departure from 
linearity is very small and it changes very smoothly across the sample. Since we are interested 
in the statistical properties of the mass density field on scales much smaller than the whole 
range of the data, we can ignore the effect of such non-linear relation in our present analysis. 

A possible source of contamination comes from the presence of metal lines. We tried 
three ways to estimate the error. One way is to block the significant metal line regions 
identified by Dobrzycki and Bechtold (1996), and Scott^. Since the WFC ij^i is localized, the 
metal line regions have been separated from the rest. The metal line effect can be removed by 
not counting the DWT modes in the blocked regions. The second way is to fill those regions 
with random data which has the same mean power as the rest of the original data, and to 
smooth the data over the boundaries. The third way is to discard the metal line chunks and 
smoothly connect the good chunks of data. The justification of doing this comes from the 
fact that we are interested only in the statistical properties of the density field and not in 
the exact location of a spike in space. We found that different methods of removing metal 
lines yield different details in the local power spectrum. However, the statistical measures 
of the local power spectrum are not sensitive to the method of removing metal lines. That 
is, the uncertainty of metal lines is under control. 

Another source of contamination is the noise. To estimate the effect of the noise we 
smooth the QSO's spectrum by filtering out all extremely sharp spikes in the local power 
spectra on finest scales, which are caused by relatively strong fluctuations between two 
neighboring pixels. Since such events are on the smallest scales only, the analysis on larger 
scales actually does not depend on whether we smooth the sample or not. 

For this sample, the DWT power spectrum P^^ of the transmitted flux is shown in 
Fig. 1, where P^^ is defined in the same way as eq.(13), but the WFCs are calculated by 
the transmission F{x), i.e. ej^ = J F{x)%l)j^i{x)dx. The power spectrum of the metal-line- 
removed-and-smoothed (MLRAS) data, is also shown in Fig. 1. Corresponding to the DWT 



^See http://qso.as.arizona.edu/~jscott/Spectra/mdex.htnil 
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scale, j, the length scale equals 2^^~^ x 5h~^ kpc. The MLRAS power spectrum is the same as 
the original data in the range 6 < j < 11. The smoothing reduces the power on small scales 
{j > 11). However, the differences between the original and MLRAS power spectra, whether 
on small scales or large scales, are much lower than the variance, hence the differences are 
statistically insignificant. 



3.2. Spiky structures of local power spectrum 

Fig. 2 shows the normalized local power spectra P^y/P/^. Fig. 3 is Pj^^j^ ^^y/ Pf with 
js = 8, i.e. the local power spectrum averaged on a scale of 0.64 h~^ Mpc. The right panels 
of Figs. 2 and 3 represent the corresponding local power spectra of the phase-randomized 
(PR) data, which is obtained by taking the inverse transform of the Fourier coefficients of 
the original data after randomizing their phases uniformly over [0, 27r] without changing the 
amphtudes. Therefore, the mean powers of the left and the right panels of Figs. 2 and 3 are 
actually the same on the same scale. 

Two main features can be observed in Fig. 2 and 3: First, the local power spectra of 
the real data (left panels) are significantly different from their counterparts of the phase ran- 
domized sample (right panels). The former show spiky structures, while the later are typical 
noisy distributions. The spiky structures show that the power of the flux perturbations is 
concentrated within high spikes only, while the power between two spikes is very low, or 
practically zero. The spiky structures arc still remarkable on all scales j > 10 even in the 
local power spectrum averaged on scale js — 8. 

Second, the spiky structures are more signiflcant on smaller scales, or larger j. That is, 
the ratio between the amplitudes of the spikes and the mean power is higher for smaller scales. 
In other words, the probability distribution function (PDF) of WFCs e^y is significantly long- 
tailed on small scales. This is a typical behavior of an intermittent field (Shraiman & Siggia 
2000.) 

It is well known that the random velocity field of baryonic matter generally reduces the 
power of density perturbations on scales equal or less than the velocity dispersion. As a 
consequence, the powers (Fig. 1) on small scales generally must be lower than the powers of 
the underlying mass field of the Lya absorbers. However, Fig. 2 and 3 show that neither the 
spiky feature of P^i nor that of Pj^^^ on small scales is seriously affected by the random 
velocity field. This is because the DWT modes are localized in j and a spike on local mode 
{j, I) can only be affected by a large velocity fluctuation on the same mode {j, I), regardless 
the velocity fluctuation on other modes. This reduces the effect of the velocity held on the 
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spiky structures. 

It should be pointed out that the spikes are not always located at the peaks of mass 
density field, or the position of low transmitted flux. The density peaks are the areas with 
density p{x) ^ p or the density contrast 6{x) » 1, while the spikes of the WFCs ifi 
correspond to a high difference between densities \p{xi) — p{x2)\ or flux \F{xi) — F{x2)\ on 
scales — ,X2| ~ . It is not necessary that a high-density difference (or high transmission 
difference) event be always located in high density halos (or low transmission region). For 
instance. Fig. 1 shows that the mean power of transmission ffuctuations at j = 13 is as small 
as = 2 X 10~^. Thus, even a spike > lOc at j = 13 means only \F{x + — F{x)\ ~ 

0.04F, which can occur at positions with either high or low F{x+L/2^^) and F{x). Therefore, 
the local power spectrum of the cosmic mass fleld can be studied with samples not necessarily 
in high density clumps but also in low density regions like QSOs' Lya absorption. 



3.3. Roughness of the local power spectrum 



The spiky structures, or the spatial ffuctuations of the clustering power, can be measured 



by the standard deviation of the distribution of the local power P.^. It is given by 



Fn21 1/2 



1 1/2 



(14) 



Obviously, the ratio o-j/Pj is larger if spiky structure is stronger. Fig. 1 also plots Pj +cr^- 
It shows that the spatial ffuctuations of P^y are stronger on smaller scales (larger j). 

It is more convenient to measure the spiky structures by the roughness of the local power 
spectrum, deffned as 



- 1 



(1/ 



9./ 
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(15) 



3[(i/2^)e;^:o (^X)^]^ 

The roughness is essentially the same as eq.(14), i.e., given by the 4-th order moment of 
the WFCs. The deflnition of eq.(15) includes only the irreducible correlation. It ensures 
that Rj = for a Gaussian PDF of Ij^i, and always Rj > —1, i.e. a non-zero Rj is from 
non-Gaussian clustering. 

Fig. 4 presents the roughness of the sample HS1700-I-64. It shows a signiflcant increase 
in the roughness on scales less than 0.3 h~^ Mpc. The roughness of the MLRAS sample is 
also plotted in Fig. 4. The MLRAS sample yields about the same roughness as the original 
data. The difference on scale j > 12 is due to the smoothing. 
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3.4. Power spectrum and roughness of the mass field 

Previous sections give the DWT power spectrum Pj^ and roughness Rj^ for the trans- 
mission. To compare with hnked pair model (§4), we need the DWT power spectrum Pj and 
roughness Rj of the underlying mass field traced by Lya forests. The relation between the Pj 
and Pj^ or Rj and i?J is not trivial, because the relationship between the Lya optical depth r 
and mass density contrast S of baryonic matter pf, is nonlinear, i.e. r = A{ph/ph)"' — All+S^ 
with a — 1.5 — 1.9. (e.g. Hui & Gnedin 1997). However, what we need actually is only the 
shape of the DWT power spectrum of mass field. The over-all normalization of the power 
spectrum is not important. Therefore, we will only try to show that the shape of Pj can be 
effectively constrained by the Lya transmission. 

The WFCs, ej^;, of the transmission essentially measures AF, i.e. the difference between 
F{xi) and F{x2) with \xi — — If AF is small, which is generally true, the DWT 

is analogous to finite difference. The F — S relation then yields 



F{l)jaA[l + 5il\ 



(16) 



where ij^i is the WFC of the mass contrast 5. F{l)j and 5{l)j are, respectively, the mean flux 
and mean mass contrast in the spatial range < x < L{1 + l)/2-'. 

Using cq.(16), one can study the relation between ej^i and e^i at each position /. At 
positions with \S{1)\ < 1, i.e. clustering is weak, we have approximately 



1 € 



aA F{l)j aA e" 



;i7) 



At positions with 5{l) > 1, we have 



< 



aAF{l), 



(18) 



For voids, i.e. S{1) ~ —1, ej^i generally is zero, which has no contribution to Pj and Rj. 
Thus, eqs.(17) and (18) give an upper limit to the DWT power spectrum of the mass held 
as 



1 



P < 



P' 



where 



2^-1 



-E 

1=0 



F(/), 



(19) 
(20) 
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In the DWT analysis, F{l)j can be calculated by (Fang & Feng 2000) 

1/2 



F{1), 



where 



-V 

2J J 



F{x)(j)j^i{x)dx. 



(21) 



(22) 



<pj,i{x) is the scahng function (Fang & Thews 1998), and efi is called scaling function coeffi- 



cient (SFC) of the transmission. With efj, P- can be calculated by 

2 



2J-1 



p' = — y 



22J 



=0 



(23) 



Fig. 1 plots and Pj for the transmitted flux of HS1700. Although there are differences 
between the power spectra Pj and Pj^, they have similar shape. On large scales, most places 
I have \S{1)\ < 1. Therefore, from eq.(17), the DWT power spectrum of mass field on large 
scales is given by 

(24) 



p. ~ 



Q2^2g-2A J ■ 

On small scales, more places have S{1) > 1. Therefore, the DWT power spectrum of the 
mass field is constrained by Pf /a^A^e"'^^ as a lower limit, and Pj/a^A^ as an upper hmit. 
The number is given by mean transmission, and is in the range 0.5-0.9. Thus, the shape 
of Pj is well constrained by the shapes of P^ and Pj, i.e. flat on large scales and rapidly 
decreasing on small scales. 

Similarly, one can estimate the roughness Rj of mass field by calculating Pj' and R'j, 
where Rj is defined by eq.(15), and R'^ is also given by eq.(15) but the WFC ej^ is replaced 
by with ^fi/^fi- However, roughness is defined as a ratio of WFCs, and the correlation 
between ej^ and ej^ is not very strong. For roughness, the effect of replacing ej*; by ^j'l/^j'i is 
weak. Thus, roughness Rj of mass field can directly be estimated by R^. 



4. Local power spectrum of hierarchical clustering 

The hierarchical clustering provides a skeleton for modeling the formation of structures 
via the merging of dark halos. It is assumed that the mass field formed by the non-linear 
evolution of the cosmic gravitational clustering can be described by the linked-pair approx- 
imation, or correlation hierarchy, i.e. the n-th irreducible correlation function is given 
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by the two-point correlation function ^2 as ^„ = Qn^2~^j where Qn is the hierarchical co- 
efficient (White 1979). It is, however, well known that correlation hierarchy with constant 
coefficients cannot match with the skewness of non-linear mass field given by the pertur- 
bation calculation and N-body simulation (e.g. Jing & Borner 1998). Moreover, the local 
power spectrum of the transmission (§3) strongly indicates that the underlying mass field of 
a QSO's Lya forest is intermittent. This implies that the correlation hierarchy would be a 
problem on small scales. In this section, we will find the applicable range of the correlation 
hierarchy by testing its predictions of the local power spectrum. 



4.1. Roughness of hierarchically clustered field 

The first test is on the roughness. Let us calculate the roughness Rj with the linked 
pair approximation. For n = 4, the hierarchical relation of mass field correlation functions 
is 

((5(X1)5(X2)(5(X3)5(X4)) = (25) 

g2[(<^(xi)5(x2))(5(x2)5(x3))(5(x3)5(x4)) + cyc. 12 terms] 
+Q^[(5(xi)5(x2))(5(xi)(5(x3))(5(xi)5(x4)) +cyc. 4 terms]. 

where Q2 is for snake diagrams and Q\ is for stars. 

Because the samples of Ly« transmitted fiux is 1-dimensional, to calculate 1-D WFCs 
we use a projection of a 3-D distribution 5(x) onto 1-D as 

/OD 
6{x)ipj^i{x^)(j)j>^rn{x'^)(pj',n{x^)dx^dx'^dx^, (26) 
■oo 

where x^ is for the redshift direction, x'^ and x^ are the dimensions of the sky, and <pj,i{;x) is 
the scaling function (§3.4). The scaling function (t)j,i{x) in eq.(26) plays the role of a window 
function on scale j at position I. With eq.(26), a 1-D field with cross-section L/2'^' x L/2'^' 
along the x^-direction can be decomposed as 

3 I 

For a QSO Lya absorption spectrum, m and n denote the position of the QSO on the sky, 
and scale J' is determined by the size of the absorption clouds. Actually, we don't know the 
exact scale J' . However, the details of 4'J',m{x^) and (pj^nix^) do not affect the conclusions 
below. 
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Using the decomposition eq.(27), eq.(25) yields 



j',i' 



(28) 



i>j,l{x2)i>j',l'{x2)i>j",l"{x2)dX2 J ilj,l{x^)ilj"',l"'{x^)ilj"",l""{x^)dXz 

+cyc. 12 terms] 



I 



'ipj,i{^i)'4^j',i'{xi)ipj",i"{xi)ipj>"^i'"{xi)dxi +cyc. 4 terms], 



where subscript ir stands for the irreducible correlation function, Ba = J 0j/ mi^^)'^% ^^{x^)dx^dx^ 
and Bi, = J (f)'^^, .^^^{x^)(f)'^j, ^^{x^)dx'^dx^. These constants can be absorbed into coefficients Q1 
and Q\, respectively. We will no longer show the two constants explicitly. 

Because, the covariance is generally quasi j-diagonal at least for the clustering 

referred to QSO Ly« absorption (Feng & Fang 2000), the r.h.s. of eq.(28) is dominated by 
the terms (e^,;)^- We have then 



(29) 



where the factors and are given by 



«5 = J ^Ux)dx = 



1/2 



'4'^{x)dx, 



where %l){x) is the basic wavelet (Fang & Thews 1998). 



(30) 
(31) 



Thus, from eqs.(29) and (15), which include only the irreducible correlation, the rough- 
ness of a hierarchically clustered field is given by 



where the hierarchical coefficient Qf is given by 
and 

A r r 

ip^{x)dx 



(32) 

(33) 
(34) 
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^b=ljj i^\x)dx. (35) 

As expected, in the linked-pair approximation the roughness is completely determined by 
the power spectrum Pj (two-point correlation function) and coefficient Q^. 

The dotted-line curve in Fig. 4 is Rj calculated by eq.(32), but Pj is replaced by 
P'y Therefore, the dotted-line curve in Fig. 4 actually is an upper limit to the linked-pair 
predicted roughness for mass field. Fig. 4 shows that, with a constant fitting, the 
linked-pair predicted Rj cannot match the observation on scales less than 0.3 h^^ Mpc, as 
the predicted Rj is smaller on smaller scales, while the observed result is larger on smaller 
scales. This result depends only on the shape of the power spectrum. The decrease of 
the linked-pair predicted roughness Rj with j on scales less than 0.3 h~^ Mpc is due to the 
decrease of Pj and P^ with j. Since the shape of mass field power spectrum Pj is constrained 
by Pj or P^ , one can conclude that the hierarchical clustering model with constant (^4 is a 
good approximation on scales > 0.2 h~^ Mpc. 



4.2. Scale-scale correlations of hierarchical clustered field 

Figs. 2 and 3 show that some spikes on different scales j have the same physical position. 
That is, the locations of spikes on different scales are correlated. For instance, a singular 
structure like p{r) oc r~" (§1) is a place where the large density difference (|p(a;-|-r) — p{x)\) 
events on different scales r are in phase. This is known as scale-scale correlation. It can be 
measured by the correlations between Pjj and Pjiji with j ^ j'. In the hierarchical clustering 
model, the scale-scale correlation is also determined by the linked-pair approximation. This 
provides the second test for the hierarchical clustering model. 

To measure this correlation, we use the normalized local power spectrum as 

Pj,i = ^- (36) 

Obviously, (pj^i) = 1. The correlation between local power spectra on scales j and j + I can 
be calculated by 

^ 20+1) -1 

Cf^^ J2 PUi/m+hi (37) 

1=0 

(2) 

where the brackets denote the integer part of the quantity enclosed. Cj is greater than 1 
if the spikes on the scale j have higher than random probability of appearing at the same 
physical position as j -|- 1 spikes. It should be emphasized that although C- is also 4-th 
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order statistics, and it is independent of Rj. Correlation (37) can be generalized to any pair 
of scales j and /. 

Using a similar approach for deriving eq.(32), one can find the expression of Cj^^ for a 
hierarchically clustered field. However, it is rather complicated. Noting that power on small 
j is always larger than that on large j, especially on small scales (large j), we have 



where the hierarchical coefficient is 



Q4 = KQ2 + KQ\. 



and 



4 

+ 1 



tjj^{x)dx 



M = l 



il;\x)iP'^{2x)dx. 



(38) 



(39) 



(40) 
(41) 



Similar to eq.(32), in the linked-pair approximation the scale-scale correlations are completely 
determined by the power spectrum Pj (two-point correlation function) and coefficient Q4. 

Again, to test the lined-pair prediction (38), we should calculate C of mass field. 



Since Cj^"* is also defined by a ratio of WFCs, the effect of F — 6 nonlinearity on Cj^' is also 
weak. We calculate the correlation Cf ^ by eq.(37) for the sample HS1700+64. The result 



(2) 



is plotted in Fig. 5. It shows a strong correlation 
range we have approximately a power law as 



(2) 



(2) 



(X 2^>, 



on small scales (j > 9), and in this 



(42) 



with index // ~ 0.9. 



Fig. 5 also shows the linked-pair predicted Cj^^ given by eq.(38), where Pj is replaced 
by Pj. The hierarchical clustering with a constant value of Q4 basically are able to fit the 
observation on scales j < 9 or > 0.2 h~^ Mpc, but fail on small scales. Similar to Fig. 4, 
this result depends only on the shape of the power spectrum. The over-all normalization of 
the power spectrum can be absorbed in the factor . 



4.3. Scale-dependent Q4 

To apply the hierarchical clustering model to small scales, one can assume that the 
coefficients and are scale dependent. That is, the deviation between the linked- 
pair prediction and the observation shown in Figs. 4 and 5 could be eliminated by using 
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scale-dependent Qf and Q] 



'4 given by 




(43) 



and 




(44) 



However, eqs.(43) and (44) pose a new problem. In the linked-pair approximation 
eq.(16), there are two coefficients and Q\. Therefore, the 4th order correlation hierarchy, 
{4 = Qi^2: with scale-dependent Q4 is reasonable only if the two coefficients and Ql 
possess the same scale-dependence. In other words, that Qf and Q'^ have the same scale- 
dependence is a necessary condition to use the 4th order correlation hierarchy. Therefore, 
whether Qf and have the same scale-dependence is a test of the hierarchical clustering 
with scale-dependent Q. 

This test, however, needs the DWT power spectrum of mass field. An upper limit 
spectrum given by Pj seems not to be enough. Yet, our purpose is not to obtain the values 

of and , but their behavior of j-dcpcndence. Fig. 6 shows the j'-dependencics of Qf 
and calculated by eqs.(43) and (44) with Pj^ (lower panel) and Pj (upper panel). Although 
the values of and given by Pj and Pj are significantly different from each other on 
small scales, the two hierarchical coefficients {Qf, Q4), and so {Q2, Q\) have the same j 
dependent behavior in the range from j = 6 to 13. Since Pj has the similar shape as Pj^ 
and Pj, Fig. 6 strongly indicates that one scale-dependent Q4 probably is reasonable in the 
scale range from 2.5 h~^ Mpc to few tens h~^ kpc. 



The local DWT power spectrum provides an unified description of the power distribution 
of clustering in both scale space and physical space. That is, it contains information about 
the amplitudes and phases of the density perturbations. With this tool, the central part 
(or the variance) of the probabihty distribution function (PDF) of the density difference 
\p{x + r) —p{x) \ can be measured by the averaged local DWT power spectrum, while the tail 
of the PDF can be measured by the roughness of the local DWT power spectrum. Therefore, 
it is effective to describe the non-linear evolution of the cosmic mass field. 

With the local power spectrum of Lya transmitted fiux of QSO HS1700, we find that 
the underlying cosmic mass field of the transmitted fiux with redshift around 2; ~ 2.2 can 
be described by the hierarchical clustering model on the physical scales from 2.5 h~^ Mpc 



5. 



Conclusions and discussions 
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to few tens kpc. But the non-linear features of clustering are different on different scale 
ranges. 1. On physical scales larger than ~ 1.3 h~^ Mpc, the field is almost Gaussian. 2. On 
scales 1.3 h~^ Mpc - 0.3 h^^ Mpc, the field is consistent with the correlation hierarchy with 
a constant value for the coefficient Q4. 3. On scales less than 300 h~^ kpc, the field is no 
longer Gaussian, but essentially intermittent. In this case, the field can still be fitted by the 
correlation hierarchy, but the coefficient, (^4, should be scale-dependent. The above three 
points are strongly supported by the following result: the scale dependencies of Q4 given 
by two statistically independent measures, i.e. Qf by the roughness and by scale-scale 
correlation are the same in the entire scale range considered. 

In the clustering of cosmic mass field, the mass perturbation on small scales evolved into 
the non-linear regime early, followed by the large scale perturbations. Therefore, the above- 
mentioned result implies that the non-linear evolution of the cosmic mass field underwent 
the following stages: Gaussian - hierarchical clustering with constant Q - intermittent or 
hierarchical clustering with scale-dependent Q. 

The local power spectrum can detect the scale range of the non-linear evolution as well 
as the intermittent behavior of the cosmic mass field. It is, hence, a potential discriminator 
amongst models of structure formation. An advantage of the intermittent discriminator is 
that the non-linear behavior of the cosmic mass field can be tested not only with high density 
objects, like the centers of massive halos, but also with low density objects, like QSO's Lya 
forests. 

It is not difficult to generalize this analysis to Qn with n > 4 if better data are available. 
Generally, the nth correlation hierarchy ^„ = Qn^2~^ can be tested by calculating the nth 
moment of the PDF of the WFCs. 
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Fig. 1.— The DWT power spectrum Pf of the original transmitted flux of HS1700+64, 
the mctal-linc-removed-and-smoothed (MLRAS) flux, and Pj as defined by eq.(37). The 
horizontal axis represents the physical scale of 2^^~^ x 5h~^ kpc. The values of P?^ + crj are 
also shown by error bars. 
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Fig. 2. — The normalized local power spectrum P^J {j = 10 — 14) of the transmitted flux 
of HS1700+64 (left panels), and its phase-randomized (PR) counterparts (right panels). The 
horizontal axis represents relative proper distance (a; / x 5 x 2^^~^ h~^ Kpc) in an Einstein-de 
Sitter universe. 
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Fig. 3. — The normalized local power spectrum, P^^ ^ }/^f^ transmitted flux of 

HS1700+64 (left panels), and its phase-randomized (PR) counterpart (right panels) with 
js = 8. The horizontal axis represents relative proper distance (a; Ig x 640 h~^ Kpc) in an 
Einstein-de Sitter universe. 
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Fig. 4. — The roughness, of the original flux, the metal-line-removed-and-smoothed 
(MLRAS) flux, and the prediction from the correlation hierarchy model with a constant . 
The gray band is the 90% confidence of the phase-randomized (PR) fiux. The vertical axis 
is + 1. This made easy for the logarithmic scale of Rj in the range > i?j > — 1. 
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Fig. 5. — The correlation, Cj^\ of the original flux, the metal-line-removed-and-smoothed 
(MLRAS) flux, and the prediction from the correlation hierarchy model with a constant Q^. 
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Fig. 6. — The scale-dependence of the hierarchical coefficients and given by eqs.(42) 
and (43) with power spectrum (lower panel) and P' (upper panel.) 



